AIC and BIC based approaches for SVM parameter value estimation with RBF kernels

نویسندگان

  • Sergey Demyanov
  • James Bailey
  • Kotagiri Ramamohanarao
  • Christopher Leckie
چکیده

We study the problem of selecting the best parameter values to use for a support vector machine (SVM) with RBF kernel. Our methods extend the well-known formulas for AIC and BIC, and we present two alternative approaches for calculating the necessary likelihood functions for these formulas. Our first approach is based on using the distances of support vectors from the separating hyperplane. Our second approach estimates the probability that the SVM hyperplane coincides with the Bayes classifier, by analysing the disposition of points in the kernel feature space. We experimentally compare our two approaches with several existing methods and show they are able to achieve good accuracy, whilst also having low running time.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Impact of Patients’ Gender on Parkinson’s disease using Classification Algorithms

In this paper the accuracy of two machine learning algorithms including SVM and Bayesian Network are investigated as two important algorithms in diagnosis of Parkinson’s disease. We use Parkinson's disease data in the University of California, Irvine (UCI). In order to optimize the SVM algorithm, different kernel functions and C parameters have been used and our results show that SVM with C par...

متن کامل

Optimizing kernel parameters by second-order methods

Radial basis function network (RBF) kernels are widely used for support vector machines (SVMs). But for model selection of an SVM, we need to optimize the kernel parameter and the margin parameter by time-consuming cross validation. In this paper we propose determining parameters for RBF and Mahalanobis kernels by maximizing the class separability by the second-order optimization. For multi-cla...

متن کامل

A New Application of Hidden Markov Model in Exchange Rate Forecasting

This paper presents a new application of Hidden Markov Model (HMM) as a forecasting tool for the prediction of the currency exchange rate between the US dollar and the euro. The results obtained show that the difference between price gaps which consists open, high, and low price can be selected to produce the best model parameter of Hidden Markov Model. Three model parameters based on Akaike In...

متن کامل

Empirical Exploration of Extreme SVM-RBF Parameter Values for Visual Object Classification

This paper presents a preliminary exploration showing the surprising effect of extreme parameter values used by Support Vector Machine (SVM) classifiers for identifying objects in images. The Radial Basis Function (RBF) kernel used with SVM classifiers is considered to be a state-of-the-art approach in visual object classification. Standard tuning approaches apply a relative narrow window of va...

متن کامل

Exploring Kernels in Svm-based Classification of Larynx Pathology from Human Voice

In this paper identification of laryngeal disorders using cepstral parameters of human voice is investigated. Mel-frequency cepstral coefficients (MFCC), extracted from audio recordings, are further approximated, using 3 strategies: sampling, averaging, and estimation. SVM and LS-SVM categorize preprocessed data into normal, nodular, and diffuse classes. Since it is a three-class problem, vario...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012